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1. Introduction 

Entropy plays a significant role in both classical and quantum information theories 
and is characterised by various measures, including the Shannon entropy in classical 
information theory and the von Neumann entropy for a density operator of a quantum 
system. These entropy measures are related, because the von Neumann entropy of a 
density operator equals the Shannon entropy of the eigenvalues of this operator. The 
von Neumann and Shannon entropies are the standard entropy measures, but other 
entropy measures are also employed. 

For quantum systems, the linear entropy is widely employed. The linear entropy is 
easier to calculate than the von Neumann entropy in general, hence its appeal. Other 
entropy measures are also employed, including the Tsallis entropy P and the a, or 
Renyi, entropy PJ. A common way of describing these entropy measures is via the 
trace over a concave function of the density operator. This general entropy measure has 
been widely studied both in the context of classical probability distributions and mixed 
quantum states jSj- 

This work is motivated by problems where one entropy measure is required, but it is 
only possible to obtain analytic results for another entropy measure. However, the exact 
result for the desired entropy measure may not be required. Driven by this motivation, 
we establish a method by which one entropy measure can be estimated from another 
entropy measure that may be easier to calculate. Specific examples of this problem 
have been considered in [U El IE] ; here we derive the general result for general entropy 
measures in both the classical and quantum contexts. 

General entropy measures for classical information and for quantum information are 
discussed in section El In section 01 we show that the states and probability distributions 
given in jJl IE] extremise (minimise or maximise) general entropy measures for a given 
value of another generalised entropy provided that a concavity /convexity condition is 
satisfied. In section HI we apply our methods to particular examples and provide an 
example of an entropy measure that violates the concavity/ convexity condition. We 
conclude in section 

2. General measures of entropy 

Three common measures of quantum entropy are the von Neumann, linear and Renyi 
entropies. The von Neumann entropy for density operator p is given by Svn(p) = 
— Tr(plogp), where the notation log is used for logarithms base 2. The linear entropy 
is defined by Sii n (p) = 1 — Tr(p 2 ), and the a or Renyi entropy [2] by 

^ a (p) = -l^logTr(p a ). (1) 

These three entropy measures are all calculated from an expression of the form TrF(p). 
In order to derive general results, we therefore consider general entropy measures 
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of the form |3] 

S,(p) = TtF(p). (2) 

The function / is a mapping [0, 1] i— > M, and F is the corresponding operator function 
defined by 

F(p) = ^/(A,)|^)(^| (3) 

i=0 

where Aj and |0j) are the eigenvalues and eigenstates, respectively, of p, and o? is the 
dimension of the Hilbert space. The entropy measure Sf therefore only depends on 
the eigenvalues of the density matrix, and may be calculated as Sf(p) = J2 i /(Aj). We 
require that the function / satisfies the following three conditions: 

Condition 1: f(0) = 0. 

Condition 2: The function / is strictly concave or strictly convex. 

Condition 3: The first derivative /' exists and is continuous in the interval (0, 1). 

All the examples of entropy measures above satisfy these three conditions. The first 
condition allows us to embed the Hilbert space in another of larger dimension without 
changing the value obtained for Sf. The second condition implies that the extremal 
values of the entropy are obtained for pure and maximally mixed states. This result 
follows from the following lemma: 

Lemma 1. Let f : [0, 1] — > R be a function such that /(0) = 0, and let {A,} be a set of 
d non-negative real numbers such that ^ Aj = A < 1. If f is concave (convex), then the 
minimum (maximum) value of^2 li f{\i) is obtained for one of the Aj equal to A and the 
rest zero, and the maximum (minimum) value o/^/(Ai) is obtained for all \ equal. 

Proof. This result is well known; however, we show the result here for completeness. 
Concavity (convexity) implies 

E (<) E K 1 " V A )/(°) + ( VA)/(A)] = /(A). (4) 

i i 

Thus the minimum (maximum) value of /(Aj) is obtained for one of the \ equal to 
A and the rest zero. Similarly concavity (convexity) implies 

£)/(A,) ; dxf(A/d) (5) 

i 

so the maximum (minimum) value of /(Aj) is obtained for all Aj equal to A/d. □ 

Note that, because we allow the possibility that / is strictly convex, our measure 
may be considered to be a measure of entropy or of purity (for simplicity we always call 
it entropy). This generality is useful because it allows us to easily apply our results to 
cases such as the linear entropy and the a entropy. The third condition is not absolutely 



Bounds on general entropy measures 



4 



necessary for Sf(p) to be a reasonable entropy measure. However, we include it because 
it is necessary in order to derive the bounds in the next section. Note that we do not 
require that the derivative exists at the endpoints and 1. Allowing the possibility of 
derivatives that diverge at the endpoints means that our results may be applied to the 
von Neumann entropy. Note also that conditions 2 and 3 imply that the derivative /' 
must be one-to-one. The derivative /' will be monotonically increasing (decreasing) if 
/ is convex (concave). 

Because the entropy measure Sf depends only on the eigenvalues of the density 
operator, it is equivalent to the entropy measure for classical probabilities: 

d-l 

H f ({ Pi }) = j2f&) ( 6 ) 

i=0 

where / satisfies conditions 1-3. It is clear that Sf(p) = Hf({Xi}), where {Aj} is the set 
of eigenvalues for p. This is a generalisation of the relation between the von Neumann 
entropy and the Shannon entropy. We may also define an analogous general measure of 
entanglement for pure states: 

d-l 

E f (\ij)) = S f (Tr A \i>)m) = J2f( X *) ( 7 ) 

i=0 

where / is a function satisfying conditions 1-3, \ip) is a pure state shared between two 
subsystems A and B, and A, are the Schmidt coefficients of \ip). 

The bounds that we derive in the next section may be applied to all three cases: 
Hf for classical entropy, Sf for the entropy of mixed quantum states and Ef for 
entanglement of pure quantum states. These three cases are mathematically identical, 
although the physical interpretations are different. 

3. Bounds on entropy measures 

In this section we show how to determine the upper and lower bounds on one generalised 
entropy for a given value of another generalised entropy. We will present the derivation 
in terms of the entropy for probability distributions. The results for entropies of mixed 
states and entanglement measures immediately follow from this result. 

From j3] the maximum and minimum Shannon entropies for a given value of the 
index of coincidence (where g(X) = A 2 ) are obtained for probability distributions 

{A J } = {A ,A 1 ,--- ,Ai} (8) 

where Ai = (1 — A )/(c? — 1) < A and 

{A,} = {A ,---,A ,A 1 ,0,---,0} (9) 

where Ai = 1 — A;A < A and there are k = |_1 / A J probabilities equal to A . Note that 
both probability distributions (jHJ and (jHJ) are parametrised by the single real number Ao- 
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The result given in [U] for the von Neumann and linear entropies is equivalent, except 
that the coefficients \ are eigenvalues of a density matrix. 

We provide a proof that these two probability distributions give the bounds when 
comparing general entropy measures. The specific result is given below. 

Theorem 1. Let H g = Ylidi^i) an< ^ Hf = Ylif(^i) be two entropy measures where the 
functions f and g satisfy conditions 1-3. If f'(g') is strictly convex (concave), then the 
maximum (minimum) Hf for fixed H g is obtained for probability distribution (JHJ ; and 
the minimum (maximum) Hf is obtained for probability distribution ©• 

Here, and in the following derivations, the notation f'(g') is equivalent to /'(A(g')), 
and means /' as a function of g' . Because the function g is strictly concave or convex, 
and the derivative g' exists in the interval (0, 1), g' must be a one-to-one function of A 
in this interval. Hence it is possible to invert this function to obtain A as a function of 
g' (i.e. A (</)). In turn, we may express /' as a function of g' (i.e. f'(X(g'))). 

Note that the crucial relation the entropy measures must satisfy in order for these 
bounds to hold is that f'{g') is strictly concave or strictly convex. The other restrictions 
on the functions / and g are simply necessary to ensure that these are valid entropy 
measures. 

It is also important to note that, for each value of H g , the probability distributions 
of the forms (JHJ) and are unique, and hence we obtain unique values for the upper 
and lower limits on Hf. Therefore the bounds on Hf obtained using this method are 
unambiguous. To show this result for (JHJ, the value of H g is given by 



Because g' is one-to-one and A > (1 — Xo)/(d — 1), dH g /d\ always has the same sign, 
except at Ao = (1 — Ao)/ (d — 1) where it is zero. This point is a boundary to the range 
of A ; thus, H g must be a one-to-one function of A . Hence, for each value of H g , there 
is a unique value of A and therefore a unique probability distribution (JHJ). 

The situation is similar for the probability distribution (JHJ), except there is an 
additional complication due to multiple values of k. In the same way as for (JHJ), we 
can see that in each interval where k is a constant {l/{k + l),l/k], H g is a one-to- 
one function of Ao- In particular, if g is convex (concave), then H g is monotonically 
increasing (decreasing). In addition, it is easy to see that H g is continuous at the 
boundaries where 1/Ao is an integer. Thus H g is a one-to-one function of Ao, and each 
value of H g corresponds to a unique probability distribution (JHJ). 

The method we will use for the proof is to first consider the restricted case for three 
probabilities in lemmas 3-5, and then apply the result to prove theorem 1. When there 
are only three probabilities, the problem reduces to finding the maximum and minimum 




(10) 



so 




(11) 
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of a function of a single real variable. This problem is relatively straightforward, and 
may be solved by finding the boundaries of the domain of the function, as well as the 
turning points. Before we proceed to the case for three probabilities, there is a minor 
result that we need to prove for the case of two probabilities. 

Lemma 2. Let g : [0, 1] i— > R be a function satisfying conditions 1-3. In addition, let 
Ao and X\ be two numbers in the interval [0, 1], with the constraints 

A + A 1 = A( 2 ) <7(A ) + g(X 1 ) = iff (12) 

where < A^ 2 ^ < 1. There are at most two solutions to (|12j). and these solutions differ 
by a permutation. 

We use the notation convention that a superscript indicates a sum over fewer than 

(2) 

d probabilities. The numbers A and Ai are only two probabilities, so H g is not the 
same as the entropy H g . The superscript (2) indicates that only two terms have been 
summed. 

Proof. Solving (fT2"j) is equivalent to solving 

g(X ) + g(A {2) - A ) = iff. (13) 

If A^ 2 ) = 0, then there is only one solution, Ao = Ai = 0. If A^ 2 ^ ^ 0, then we may de- 
termine the number of solutions by considering the turning points of the left-hand-side 
(LHS). For a turning point we require g'(Xo) — g'(A^ 2 ' — Ao) = 0. Since g' is one-to-one, 
the only turning point is for Ao = A^ 2 ^/2. Thus there can be at most two different values 
of A that give the same value for the LHS of (fTSJ). Denoting one solution for A as X g 
(so Ai = A^ 2 ) — X g ), the other solution is for Ao = — X g , in which case Ai = X g . 
Therefore the two solutions are simply related by a permutation. □ 

Next we require a result on the problem of finding the region of values that the 
three probabilities may take given restrictions on these probabilities. 

Lemma 3. Let g : [0, 1] ^ R be a function satisfying conditions 1-3. In addition, let 
Xq, Xi and A 2 be real numbers in the interval [0, 1] with the restrictions 

Ao + Ai + A 2 = A^ (14) 

where < A^ 3 ) < 1 and 

g(X )+g(X l )+g(X 2 ) = H^. (15) 

The number Ao may take values within one or more subintervals of [0,1]; at the 
boundaries of these subintervals, either one of the A, is equal to zero, or two are equal. 

Proof. Note first that two possible boundaries for Ao are at and (if Ao = A^ 3 ) 
then Ai = A 2 = 0). To find other possible boundaries, consider solving for Ai and A 2 for 
a given Ao- The expression to solve may then be given as 

g(X ) + g(X 1 ) + 2(A< 3 ) - A - A x ) = Hf\ (16) 
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For a given Ao, Ai takes values in the region [0, A( 3 ) — Ao], and the LHS has a turning 
point at Ai = (A^ — A )/2. For the points Ai = and Ai = A^ 3 ^ — A , there is at least 
one Aj which is zero, whereas at Ai = (A® — Ao)/2, Ai and A2 are equal. 

The three points {0, (A^ 3 ) — A )/2, A^ 3 ) — A } are the three possible values of Ai 

where the LHS is at a maximum or a minimum for a given Ao- If there is no solution 

(3) 

for Ai, then the maximum and minimum are either both above or both below Hg . On 

(3) 

the other hand, if there is a solution, then Hg must be between the maximum and 
minimum, or equal to one of these values§. The maximum and minimum vary continu- 
ously with Ao- Therefore, as we pass from a region where there is a solution to a region 

where there is no solution, either the maximum or the minimum must pass through 
(3) 

H g . Hence, at a boundary of the region of values that Ao may take, either at least one 
of the Aj is zero, or at least two are equal. □ 

Now we apply this result to the bounds problem for the case of three probabilities: 

Lemma 4. Let f and g be functions [0, 1] 1— ► R such that conditions 1-3 are satisfied. 
Let A 0; A 1; and A 2 be real numbers in the interval [0,1] with the restrictions (fT4*j) and 
(fT5|) . and let Hf be defined by 

Hf=f(\ ) + f(X l )+f(X 2 ). (17) 



If f'(g') is strictly convex or concave, then the extremal values of Hj are obtained wh 
at least one of the Aj is zero or at least two are equal. 

Proof. Note first that, from lemma 2, for a given value of Ao there are at most two 
solutions of (JUJ) and (fTKjl for Ai and A2, and one solution is a permutation of the other. 
Thus, for each value of Ao, there is only one possible value of H^\ Therefore H^p is a 
single- valued function of Ao, and we may find the maximum and minimum by finding 
the boundaries of the region of values that Ao may take, as well as the turning points. 
From lemma 3, at the boundaries of the region of values that Ao may take, either one 
of the Aj is zero, or at least two are equal. 

To complete the proof, it remains to be shown that there are no turning points for 
values of Ao such that the Aj are nonzero and unequal. For a turning point, we require 
that dHf' /dAo changes sign. Taking the derivative of (fTTj) with respect to A gives 

^ /(Ao) + ^ /(Al) + ^ /w (18) 

To remove the derivatives dAi/dAo and dA2/dAo, we may take the derivatives of (|T4*j) 
and (|T5)l with respect to A , and substitute into (fISj). We then obtain 



en 



dH 



(3) 
/ 



dA 



.T(Ai) - f (Ao) f (Ag) - /'(Ao) 
<7'(Ai) - <7'(A ) <7'(A 2 )-<?'(Ao) 



[^(A 2 )-^(Ao)][^(Ai)-^(Ao)] 
<7'(Ai)-<7'(A 2 ) 



(19) 



§ We use the convention that the terminology 'between' means not equal unless otherwise specified. 
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Because g' is one-to-one, if the Aj are unequal, then the terms in the denominators are 
nonzero, and the derivative dH^ /dAo is continuous. In that case, for there to be a 
turning point, we require that the derivative is zero, which implies 

f (Ai) - f (Ao) /' (A 2 ) - /' (Aq) 

ff'(Ai) - 5 '(Ao) <?'(A 2 ) - <?'(A ) ' 1 Uj 

This expression implies that the three points (g'(\o), f'(Xo)), (g'(Ai), f'(Xi)) and 
id'i^), /'(A 2 )) lie along a straight line. This is not possible with unequal probabili- 
ties if f'(g') is strictly convex or strictly concave. Thus we see that there are only two 

(3) 

possibilities for a maximum or minimum of H ^ : one of the Aj is zero, or two are equal. □ 

The last lemma we show is a refinement of lemma 4 to account for when the various 
solutions occur and whether they give a maximum or a minimum. 

Lemma 5. Let f and g be functions [0, 1] t— > M. such that conditions 1-3 are satisfied. 
Let Ao, Ai and A 2 be real numbers in the interval [0, 1] with the restrictions ((Hj) and 
(fl3|) . and let Hj be defined as in (fTTj). If f'(g') is strictly convex (concave), then the 
maximum (minimum) Hj is obtained only if two Aj are equal and one is larger or 
equal, and the minimum (maximum) Hj is obtained only if one of the Aj is zero, or two 
are equal and one is smaller or equal. 

Proof. In the case that one of the Aj is zero, we may take Ao to be zero without loss 
of generality. Using lemma 1, the extremal values of Hg 3 ^ are g(A^) and 2g(A^ /2). 
In general, the extremal values of Hg are obtained for all Aj equal, giving H g = 
3g(A^/3), and all probabilities zero except for one, giving H^ 3) = g(A&). Therefore 
Hf ] may take values from #(A (3) ) to 3g(A (3) /3). It is easily seen that 2#(A (3) /2) lies 
in this interval. If lies between g(A( 3 )) and 2g(A^ /2), or is equal to one of these 
values, then there is a solution with A = 0. If #J 3) is between 2g(A^ /2) and 3#(A( 3 ) /3), 
or equal to 3g(A^ /3), there is no solution with Ao = 0. 

For the other case, where at least two of the Aj are equal, we may take Ai = A 2 
without loss of generality. Then the restrictions (fPfj) and (|T3jl give 

^(Ao) + 2^[(A( 3 )-Ao)/2] = ^f. (21) 

To determine the number of solutions to this, we may consider the LHS as a function of 
A . The number A is in the range [0, A^], and there is one turning point at A = A^ 3 ^/3. 
Therefore there may be at most two solutions to equation (|2~T|) . 

To be more specific, the LHS takes the values 2s-(A( 3 72), 3sf(A (3) /3) and g(A^) 
for A equal to 0, A^ 3 ^/3 and A^ 3 \ respectively. This situation is illustrated in figure [T] 
for the case where g is strictly concave. There are five qualitatively different situations 
for different values of Hf ] from #(A< 3 )) to 3^(A( 3 )/3): 

1. For H^f 1 = g(A^) (line A), there is only one possible solution, which corresponds 
to all the Aj being zero except one. 
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B 


2g(A (3) /2) 
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g(A (3) ) 





A< 3 >/3 . 

^0 


A (3) 



Figure 1. An example of the variation of the LHS of equation H21(l as a function of 
Ao for the case where g is strictly concave. 

2. If Hg 3 ^ lies between g(A^) and 2g(A^ /2) (between lines A and B), there can be 
only one solution with Ai = A2. This solution is for Ao in the interval (A( 3 )/3, A^ 3 )). 
There will also be a solution with Ao = 0, giving a total of two solutions. 

3. If Hf is equal to 2g{A^ /2) (1 ine B), then there are two solutions with Ai = A2, 
one for Ao = and the other for Ao in the interval (A' 3 '/3, A^). We can also obtain 
a solution by setting A = 0; however, this solution is identical to the solution for 
Ai = A2 where Ao = 0. Therefore there are only two distinct solutions. 

4. For Hg 3 ^ in the range between 2g(A^/2) and 3^(A( 3 )/3) (between lines B and C), 
there are two solutions with Ai = A2, one for Ao in the range (0,A( 3 )/3) and the 
other for Ao in the range (A^ 3 ^/3, A^ 3 ^). There is no solution with Ao = 0, again 
resulting in a total of two solutions. 

5. The last possibility is Hg 3 ^ = 3g(A^ /3) (line C), in which case all the A; are equal. 

Thus we find that, for Hg 3 ^ between 3g(A^ /3) and g(A^), there are always two 
solutions where either one of the Aj is zero or two are equal, thereby providing a 
maximum and minimum for H^ 3 \ If is equal to 3^(A®/3) or g(A^), there is 
only one possible solution, so the maximum and minimum coincide. 

(3) 

In order to determine which solution gives the maximum of if j. and which gives 
the minimum, let us consider the solution where Ao > and Ai = A2. For H^f 1 

between g(A( 3 )) and 3g(A( 3 )/3) there are always two distinct solutions, one of which is 
of this form. Therefore we may determine which solution gives the minimum and which 
gives the maximum by only considering this case. This value of Ao is an upper boundary, 
because the other solutions for Ao are smaller. Let us consider a value of Ao slightly 
below this solution, so Ai 7^ A2. We may take Ai to be the larger value, so Ao > Ai > A2. 

If g is convex, then g'(A ) > gW) > g'(A 2 ), and if g is concave, then g'(A ) < 
g'(Ai) < g'(A 2 ). Therefore the multiplying factor in braces in equation (|T9*j) is positive 
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if g is convex, and negative if g is concave. It is also easy to see that, if f'(g') and g 
are both convex or both concave, then the first term in the square brackets in equation 
(119)) is greater than the second term. If one of f'(g') and g is convex and the other is 
concave, then the first term in the square brackets is smaller than the second term. 

Thus we find that dHj /dAo is positive if / (g ) is convex, and negative if f'(g') is 
concave. Therefore, for f'(g') convex, as we increase Ao up to its maximum value, Hf 
is increasing, and the solution where Ao > Ai = A2 must be a maximum. Similarly, for 
f'(g') concave, the solution where Ao > Ai = A2 is a minimum. □ 

Now that we have solved the case for three probabilities, we may extend the solution 
to the general case with d probabilities. Thus the proof of theorem 1 is as given below. 

Proof of theorem 1. We wish to find the maximum and minimum of Hf = £\ /(Ai) 
with fixed H g = an d = 1- To solve this case, let {Aj} be a set of 

probabilities that maximises Hf. We then select any three probabilities Aj , Aj 1 and Aj 2 , 
and define I to be the set of indices {i , i±, z 2 }, and I 1 - to be the set of indices excluding 
i". If the set of probabilities {Aj} maximises the sum ^ i /(Ai), then the set {A io , A ii; Aj 2 } 
must maximise the sum 



where A (3) = 1 - Xi and H* = H g - X^ e7 ± #(Ai). From lemma 5, if f'(g') 



is strictly convex (concave), Hj is maximised (minimised) only with probabilities of 
the form Ao > Ai = A2. That is, Hj being maximised (minimised) implies that the 
probabilities are of this form. The only way that this criterion can be satisfied for all 
subsets of three probabilities is if all the probabilities are equal, except for one which 
may be larger. Therefore the probability distribution must be of the form (|5|). 

Similarly, for f'(g') strictly convex (concave), Hj will be minimised (maximised) 
only for probabilities of the form Ao < Ai = A2, or for one of the probabilities equal to 
zero. The only way that this criterion can be satisfied for all subsets of three probabil- 
ities is if a number of the probabilities are equal, one is smaller and the rest are zero. 
Therefore the probability distribution must be of the form (jSJ. Thus we have proven 
each of the alternative cases for theorem 1. □ 

Although we have presented the above analysis in terms of probabilities, identical 
results hold for entropies of mixed states and entanglements of pure states. The 
eigenvalues of density matrices or Schmidt coefficients of pure entangled states may 
be analysed in the same way as probabilities, so we have the following two corollaries. 

Corollary 1. Let S g (p) and Sf(p) be two entropy measures where the functions f 
and g satisfy conditions 1-3. If f'(g') is strictly convex (concave), then the maximum 




(22) 



with the restrictions 





(23) 
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(minimum) Sf for fixed S g is obtained for a state with eigenvalues of the form (JSJ), and 
the minimum (maximum) Sf is obtained for a state with eigenvalues of the form ©• 

Corollary 2. Let E g (\ip)) and Ef(\ip)) be two entanglement measures where the 
functions f and g satisfy conditions 1-3. If f'{g') is strictly convex (concave), then the 
maximum (minimum) Ef for fixed E g is obtained for a state with Schmidt coefficients 
of the form (JHJ), and the minimum (maximum) Ef is obtained for a state with Schmidt 
coefficients of the form (jHJ) . 



4. Applications 

Next we consider applications of these results. As our first application, consider the 
problem of maximising or minimising the von Neumann entropy for given linear entropy. 
In this situation we take 

/(A) — -A log A s(A) = A 2 . (24) 

Both / and g satisfy conditions 1-3. We find that 

/'(A) = -log A- log e </(A) = 2A. (25) 

To determine if f'(g') is strictly convex or strictly concave, we may calculate df /dg'. 
When this derivative is monotonically increasing (decreasing), f'(g') is strictly convex 
(concave). We may determine df /dg' from f"/g", which gives 

S - = (26) 
9" 2A 

Thus df /dg' is monotonically increasing, and f{g') is strictly convex. This implies, 
from corollary 1, that the von Neumann entropy is maximised for a density matrix with 
eigenvalues of the form (|SJ), and minimised when the eigenvalues are of the form (JOJ). 
Therefore, for the case of the von Neumann entropy and the linear entropy, we obtain 
the result given in [HI El - 

As another application, we may consider the comparison of two a entropies for 
different values of a: 

/(A) = A" 1 g(X) = A" 2 (27) 
where a,\ ^ oti- For this example we obtain 

/" ai(ai-l) 



g" a 2 {a 2 - 1 



-A Ql ~ a2 . (28) 



This expression will be either monotonically increasing or monotonically decreasing 
depending on the values of a. Therefore the maximum and minimum ci\ entropies are 
again obtained for the same form of states. Note that, because taking a — > 1 or 2 
also gives the von Neumann entropy and the linear entropy, these bounds hold for any 
two-way comparison between these entropy measures. 
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Figure 2. The von Neumann entropy versus the S g entropy with g (A) given by 
equation (|29|) with to = 10 (a) and u> = 4 (6). The limit that would be given by states 
of the form © is shown by the solid line and the limit that would be given by states 
of the form (JSJ) is shown by the dashed line. The shaded region is composed of a large 
number of points for randomly generated states. The dimension is d = 10. 



As an example of a case where the maximum and minimum entropies are not given 
by states with eigenvalues of the form (jHJ) and (jHJ), consider 

/(A) = -A log A g(X) = A 2 + 1.99[1 - cos(uj\)}/uj 2 (29) 

where we take uj = 10. The entropy Sf is simply the von Neumann entropy, whereas S g 
is slightly modified from the purity. We find that g"(\) = 2 + 1.99 cos(u;A), which does 
not change sign, so S g is a valid entropy measure. However, 

f - = l ° ge (30) 

g» A[2 + 1.99cos(wA)] 1 ; 

is not one-to-one for uj = 10. Therefore the entropies Sf and S g do not satisfy the 
conditions of theorem 1, even though they are valid entropy measures. 

The limits that would be given by states with eigenvalues of the forms (JEJ) and (J§|) 
are shown in figure • In addition, results for a large number of randomly generated 
states are shown. A number of points lie outside the boundaries given by the states 
of the form (jHJ and (jSJ, demonstrating that these do not provide the limits to the von 
Neumann entropy for given S g entropy. 

Nevertheless, even for this example, most of the points lie within the region between 
the two curves, and the points that lie beyond the boundary are only a small distance 
from the boundary. This example has been chosen because the points are at a noticeable 
distance from the boundaries. For other values of uj the difference is not so noticeable. 
In fact, for some values of uj there were no points found to lie beyond the boundary, 
despite the fact that f'(g') is not strictly convex or concave. An example for uj = 4 is 
shown in figure WLP) ■ These results strongly indicate that the condition that f'{g') is 
strictly convex or concave is not a necessary condition, although it is sufficient. 
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5. Conclusions 

We have shown how to determine the maximum and minimum possible values of one 
type of entropy for fixed values of another type of entropy. The forms of states that 
achieve these maximum and minimum values are the same as those given by E] for 
the case of comparing the von Neumann entropy to the linear entropy. These results 
may be applied to entropies of probability distributions, entropies of mixed states and 
measures of entanglement for pure states. 

We have identified the relation between the entropy measures that is necessary for 
these bounds to hold. This relation holds between the von Neumann entropy, the linear 
entropy and the a entropy. The bounds we have derived therefore apply to any two-way 
comparison between these entropy measures. These results allow one to estimate the 
value of one type of entropy given the value of another. 

For the examples we have examined, we have found that these bounds are a good 
approximation of the true bounds even for comparisons between entropy measures that 
do not satisfy the conditions of the proof. This indicates that, even in such cases, the 
bounds we have found may be used to estimate the value of one entropy from the other 
(without giving the exact bounds). 
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